Skip to content

Conversation

pohly
Copy link
Contributor

@pohly pohly commented Sep 29, 2025

The experiment is meant to determine whether running serial tests in the same job as the parallel tests works and how much slower it becomes.

Even long term the job probably shouldn't be release informing because the alpha tests can break it at any time, without affecting the release. What needs to become release informing instead are the kind-alpha-beta-enabled and/or kind-alpha-beta-enabled-conformance jobs (to be determined after we are done with setting everything up and they proof to be stable).

/assign @aojea
/cc @BenTheElder

From Slack:

do we already have guarantee the Serial decorator to make the behavior to run after the parallel tests? do we know it is working correctly?

[...]So that part should work. But you are right, we haven't really exercised that much. [...] Looking at my list I don't see any canaries for ci jobs. [...] Modifying ci-kubernetes-e2e-kind-alpha-beta-features instead of creating a new periodic seems safe enough.

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. area/config Issues or PRs related to code in /config size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. area/jobs sig/testing Categorizes an issue or PR as relevant to SIG Testing. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. labels Sep 29, 2025
@pohly pohly force-pushed the alpha-beta-serial branch from 1e85b85 to 21706a7 Compare October 7, 2025 08:44
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: pohly
Once this PR has been reviewed and has the lgtm label, please ask for approval from aojea. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Oct 7, 2025
@pohly
Copy link
Contributor Author

pohly commented Oct 7, 2025

Because of kubernetes/sig-release#2888 I decided to not modify the existing job and instead added another one.

…slow)

The experiment is meant to determine whether running serial tests in the same
job as the parallel tests works, how much slower it becomes, and how stable
the job is (hence periodic).

Slow, deprecated and disruptive tests are also allowed. The goal is full coverage.
@pohly pohly force-pushed the alpha-beta-serial branch from 21706a7 to ef9be07 Compare October 7, 2025 08:52
@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Oct 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/config Issues or PRs related to code in /config area/jobs cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. sig/testing Categorizes an issue or PR as relevant to SIG Testing. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants